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Abstract 

We consider a stochastic differential equation that is controlled by means of an 
additive finite-variation process. A singular stochastic controller, who is a minimiser, 
determines this finite-variation process while a discretionary stopper, who is a max- 
imiser, chooses a stopping time at which the game terminates. We consider two closely 
related games that are differentiated by whether the controller or the stopper has a 
first-move advantage. The games' performance indices involve a running payoff as well 
as a terminal payoff and penalise control effort expenditure. We derive a set of vari- 
ational inequalities that can fully characterise the games' value functions as well as 
yield Markovian optimal strategies. In particular, we derive the explicit solutions to 
two special cases and we show that, in general, the games' value functions fail to be 

. The non-uniqueness of the optimal strategy is an interesting feature of the game 
in which the controller has the first-move advantage. 

AMS 2010 Subject Classification. 91A15, 93E20, 60G40 

1 Introduction 

We consider a one- dimensional caglad process X that satisfies the stochastic differential 
equation 

dXt = h{Xt) dt + dit + (y{Xt) dWt, Xq = x G M, (1) 
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where ^ is a caglad finite variation adapted process such that = and W is a standard 
one-dimensional Brownian motion. The games that we analyse involve a controller, who is a 
minimiser and chooses a process ^, and a stopper, who is a maximiser and chooses a stopping 
time r. The two agents share the same performance criterion, which is given either by 



or by 
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where ^ is the total variation process of ^ and 
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for some positive functions h,g,5 ^ M_|_. The performance index J"" reflects a situation 
where the stopper has the "first-move advantage" relative to the controller. Indeed, if the 
controller makes a choice such that A^o 7^ and the stopper chooses r = 0, then J^(^, r) = 
g{x). On the other hand, the performance index J" reflects a situation where the controller 
has the "first-move advantage" relative to the stopper: if the controller makes a choice such 
that A^o 7^ and the stopper chooses r = 0, then J"(^, r) = | A^qI + gi.^ + ^io)- 
Given an initial condition x G M, (^*, r*) is an optimal strategy if 



J:{C.r)<J:{C,r*)<J:{i,r*) 



(5) 



for all admissible strategies (^,r), where "w" stands for either "f" or "m". If optimal strate- 
gies (^*, r*), (^*, r*) exist for the two games for every initial condition x G M, then we define 
the games' value functions by 



v[x] 



J:{C,r:) and u{x) = .rAC,^] 



(6) 



respectively 

Zero-sum games involving a controller and a stopper were originally studied by Maitra 
and Sudderth [11] in a discrete time setting. Later, Karatzas and Sudderth [7] derived 
the explicit solution to a game in which the state process is a one-dimensional diffusion 
with absorption at the endpoints of a bounded interval, while, Weerasinghe derived the 
explicit solution to a similar game in which the controlled volatility is allowed to vanish. 
Karatzas and Zamfirescu [H] developed a martingale approach to general controller and 
stopper games, while, Bayraktar and Huang [1] showed that the value function of such 
games is the unique viscosity solution to an appropriate Hamilton- Jacobi-Bellman equation 
if the state process is a controlled mult i- dimensional diffusion. Further games involving 
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control as well as discretionary stopping have been studied by Hamadene and Lepeltier |5] 
and Hamadene To a large extent, controller and stopper games have been motivated by 
several applications in mathematical finance and insurance, including the pricing and hedging 
of American contingent claims (e.g., see Karatzas and Wang [S]) and the minimisation of 
the lifetime ruin probability (e.g., see Bayraktar and Young ^). 

The games that we study here are the very first ones involving singular stochastic control 
and discretionary stopping. Combining the intuition underlying the solution of standard 
singular stochastic control problems and standard optimal stopping problems by means of 
variational inequalities (e.g., see Karatzas fB] and Peskir and Shiryaev [12], respectively), we 
derive a system of inequalities that can fully characterise the value function u. We further 
show that these inequalities can also characterise the value function v as well as an optimal 
strategy. For this reason, we call u generator of an optimal strategy. Surprisingly, we have 
not seen a way to combine all these inequalities for the generator u into a single equation. Our 
main results include the proof of a verification theorem that establishes sufficient conditions 
for a generator to identify with the value function u and yield the value function v as ell as 
an optimal strategy, which we fully characterise. In this context, we also show that the two 
games we consider share the same optimal strategy and we prove that 



The non-uniqueness of the optimal strategy when the controller has the first-move advantage 
is an interesting result that arises from our analysis (see Remark [1] at the end of Section H]). 

We use the inequalities characterising a generator and the verification theorem to derive 
the explicit solutions to two special cases. The first one is the special case that arises if X 
is a standard Brownian motion and h, g are quadratics. In this case, the generator u is 
but the value function v may fail to be C^. The second special case is a simpler example 
revealing that both of the value functions u and v may fail to be and showing that the 
optimal strategy may take qualitatively different form, depending on parameter values. 

The paper is organised as follows. Notation and assumptions are described in Section 2, 
while, a heuristic derivation of the system of inequalities characterising a generator is devel- 
oped in Section 3. In Section 4, the main results of the paper, namely, a verification theorem 
(Theorem [1]) and the construction of the optimal controlled process associated with a given 
generator (Lemma [1]) are proved. In Sections 5 and 6, the explicit solutions to two nontrivial 
special cases are derived. 

2 Notation and assumptions 

We fix a filtered probability space {Q, J-", J-'t, P) satisfying the usual conditions and carrying 
a standard one- dimensional (J-'t)-Brownian motion W. We denote by Ar the set of all (J-'t)- 
stopping times and by ^4.^ the family of all (J-'t)-adapted finite-variation caglad processes ^ 
such that ^0 = 0. Every process ^ E admits the decomposition ^ = + C,^ where 




for all X e M. 
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are (J-i)-adapted finite- variation caglad processes such tliat lias continuous sample paths, 

= = and ^1= J2 all ^ > 0' 

0<s<t 

where A^s = — for s > 0. Given such a decomposition, there exist (J^t)-adapted 
continuous processes {C,'^)'^, such that 

(ru = (r)o=o, r = (er-(r)- and f = (f)+ + (r)-, 

where is the total variation process of 

The following assumption that we make implies that, given any ^ & A^, has a unique 
strong solution (see Protter [131 Theorem V.7]). 

Assumption 1 The functions 6, a : M — ?■ M satisfy 

\b{x) — h{y) I + |cr(x) — cr(y) | < K\x — y\ for all x, y G M, 

for some constant K > and cr^(a;) > ctq for all a; G M, for some constant ctq > 0. □ 

We also make the following assumption on the data of the reward functionals defined by 

m-m- 

Assumption 2 The functions 5, (7 : R — )■ R_|_ are continuous and there exists a constant 
5 > such that 5{x) > 5 for all x G M. □ 

It is worth noting at this point that, given ^ G we may have E[^t] = 00, for some 
t > 0. In such a case, the reward functionals given by ([IJ-Q are well-defined but may take 
the value 00. 



3 Heuristic derivation of variational inequalities for 
the value function u 



Before addressing the game, we consider the optimisation problems faced by the two players 
in the absence of competition. To this end, we consider any bounded interval ]7i,72[, we 
denote by T^^ (resp., T^J the first hitting time of {71} (resp., {72}), and we fix any constants 



Given an initial condition x G ]7i,72[, a controller is concerned with solving the singular 
stochastic control problem whose value function is given by 



Ms 



Aa;;7i,72 



inf E 



-^'h{Xt)dt + 
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In the presence of Assumptions [T] and [2|, Ussc is with absolutely continuous first derivative 
and identifies with the solution to the variational inequality 

mm[Cw{x) + h{x), 1 — = 

with boundary conditions 

w(7i) = and ^(72) = C^^, 
where the operator C is defined by 

Cw{x) = -a^{x)w"{x) + b{x)w'{x) — 6{x)w{x) (8) 

(see Sun [161 Theorem 3.2]). In this case, it is optimal to exercise minimal action so that 
the state process X is kept outside the interior of the set 

Cssc = {a; e ]7i,72[ I \w'{x)\ = l}. 

Given an initial condition x G ]7i, 72[, a stopper faces the discretionary stopping problem 
whose value function is given by 



^^ds(a;;7i,72,C'7i,C'^2) = sup E 



JO 



(9) 



where X is the solution to ([T]) for ^ = 0. In this case, Assumptions [T] and [2] ensure that v^s 
is the difference of two convex functions and identifies with the solution, in an appropriate 
distributional sense, to the variational inequality 

max[Cw{x) + h{x), g{x) — w{x)^ = 

with boundary conditions 

w(7i) = and ^(72) = C^^j 

where C is defined by ([8]) (see Lamberton and Zervos [TOl Theorems 12 and 13]). In this case, 
the optimal stopping time r° identifies with the first hitting time of the so-called stopping 
region 

Sds = {x e ]7i,72[ I w{x) = g{x)], 

namely, r° = inf{t > | Xt E Sds}- 

Now, we consider the game where the controller has the "first-move advantage" relative 
to the stopper and we assume that there exists a Markovian optimal strategy (^*,t*) for 
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the sake of the discussion in this section. We expect that this optimal strategy involves the 
same tactics as the ones we have discussed above. From the perspective of the controller, the 
state space R splits into a control region C and a waiting region Wc. Accordingly, ^* should 
involve minimal action to keep the state process in the closure R \ int C of the waiting region 
Wc for as long as the stopper does not terminate the game. Similarly, from the perspective 
of the stopper, the state space R sphts into a stopping region S and a waiting region Ws, 
and T* is the first hitting time of S. 

Inside any bounded interval ]7i,72[ ^ VVs, the requirement that (^*,t*) should satisfy 
^ suggests that u should identify with u^sc defined by ([7]) for = u{ji) and Cy^ = ^(72). 
Therefore, we expect that u should satisfy 

min{£-u(x) + h(x), 1 — |-u'(a;)|} = inside Wg. (10) 

Inside any bounded interval ]7i,72[ ^ Wc, the requirement that (^*,t*) should satisfy ([5]) 
suggests that u should identify with u^s defined by for C^^ = u(7i) and C-y^ = ^(72)- 
Therefore, we expect that u should satisfy 

max[Cu{x) + h{x), g{x) — u{x)^ = inside Wc. (11) 

To couple the variational inequalities (fTOj) and (ITT!) , we consider four possibilities. The 
region WW := Wc fl Wg where both players should wait is associated with the inequalities 

Cu + h = 0, \u'\<l and g < u. (12) 

Inside the set CW := C fl Ws where the stopper should wait, whereas, the controller should 
act, we expect that 

Cu + h>0, \u\ = l and g < u. (13) 

Inside the part of the state space WS := Wc H S where the controller would rather wait if 
the stopper deviated from the optimal strategy and did not terminate the game, we expect 
that 

Cu + h<0, \u\<l and g = u. (14) 

Finally, the region CS := Cc fl 5 in which the stopper should terminate the game should the 
controller deviate from the optimal strategy and did not act, we expect that 

Cu + heR, \u'\ = l and g > u. (15) 

These inequalities give rise to the following definition. Here, as well as in the rest of the 
paper, we denote by int F and cl F the interior and the closure of a set F C R, respectively. 

Definition 1 A generator of an optimal strategy is a continuous function -u : R — > R+ that 
is with absolutely continuous first derivative inside R\i3, where i3 is a finite set, satisfies 

\u'{x)\<l for all X G R \ i3. 
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and has the following properties, where 

C = cl [int{x G M \ i3 I \u'{x)\ = l}] , 
= {a; G M I u{x) = g{x)^, Sc = cl{x G M | u{x) < g{x)^, 
S = Sw^Sc and W = M \ (C U 5) . 

(I) Each of the sets C, Sy^ and Sc is a finite union of intervals, and -B C 5c C C. 

(II) u satisfies 



Cu{x) + h{x) < 



= 0, Lebesgue-a.e. in W, 

> 0, Lebesgue-a.e. in int (C \ S) 

= Cg{x) + h{x) < 0, Lebesgue-a.e. in intiSyy 

^ G M, Lebesgue-a.e. in int Sc \ B. 



(Ill) If we denote by u'_{c) (resp., u+(c)) the left-hand (resp., right-hand) derivative of u at 
c E B, then 

either u_{c) = 1 and u_^_{c) < 1 or u_{c) > —1 and m+(c) = —1 

for all ceB. □ 

In the following definition, we introduce some terminology we are going to use. 

Definition 2 Given a generator of an optimal strategy u, we call the regions W, C and S 
waiting, control and stopping, respectively. Also, we call reflecting all finite boundary points 
X of C such that 

u{x — e) < 1 and u{x) = 1 or u{x) = —1 and u{x + e) > —1, 

for all e > sufficiently small, and repelling all other finite boundary points of C. □ 

It is worth noting that requirement (III) of Definition [1] implies that all points in B are 
repelling. The special case that we solve in Section |5] involves only reflecting boundary 
points. On the other hand, the special case that we solve in Section [6] involves repelling as 
well as reflecting points and i3 7^ 0. 



4 A verification theorem 

Before addressing the main result on this section, namely Proposition [H we consider the 
following result, which is concerned with the construction of the process ^* that is part of 
the optimal strategy associated with a given generator. The main idea of its proof is to paste 
solutions to ([T]) that are reflecting in appropriate boundary points. 



7 



Lemma 1 Consider a function u : M — t- M_|_ that is a generator of an optimal strategy in the 
sense of DefinitionUl There exists a controlled process C,* G such that 

the set {t>0\ X* e B] is finite, (16) 
X; G M \ hit C for all t > 0, m(X;+) - u{X;) = -\ACt \ = -I AX;| for all t > 0, (17) 

int = f lK(xr)=-i} d{r)t and (r )r = /* 1k(X|)=i} diCX for all t > 0, (18) 
Jo Jo 

where X* is the associated solution to (QP. 

Proof. Given a finite interval [a, /3] and a controlled process ^ G suppose that there 
exists a point x G [a, (3] and an (J^()-stopping time r with P(r < 00) > such that the 
solution to ([1]) is such that X^ = x on the event {r < 00}. On the probability space 
{fl, J-',Qt,Q), where (Qt) is the filtration defined by Qt = J^r+t and Q is the the conditional 
probability measure P(- | r < 00) that has Radon-Nikodym derivative with respect to P 
given by 

dQ ^ 1 

d¥ P(r<oo)^"<°°^' 

the process B defined by Bt = (Wr+t — Wr)l{T<oo} is a standard (^t)-Brownian motion that 
is independent of Qq = Tr (see Revuz and Yor [HI Exercise IV. 3. 21]). In this context, there 
exist (^i)-adapted continuous processes X and ^ such that ^ is a finite variation process, 



Xt = x^ [ b{Xs)ds + ^t+ [ cr{X,)dB,, 
Jo Jo 

XtG[a,/3], = / l{x,=^}dC and = / l^x^^^yd^; 
Jo Jo 

(see El Karoui and Chaleyat-Maurel [3] and Schmidt [IS]). Since (t — r)+ is an (Jv+j)- 
stopping time, Qt = J^r+t and B(t-r)+ = iWt — Wr)l{r<t} for all t > 0, 

r{t-r)+ _ _ r{t-T)+ 

=x+ b{Xs) ds + + / (t{X,) dB, 

Jo Jo 

= x+ b[X(^s-T)+) d{s - + ^(^t^r)+ + a{X(^s-T)+) dB(^s-T)+ 
Jo Jo 

= X+ l{r<s}b{X(^,_r) + ) ds + ^(^t-T)+ + l{r<s}(^{X(^s-T) + ) dWs 

Jo Jo 
(see Revuz and Yor [HJ Propositions V.1.4, V.1.5]). Similarly we can see, e.g., that 

r{t-T)+ - /"* 



In view of this observation, we can see that, if we define 



* \Xt-r, ift>T, '''' ^* \^t-r, ift>T, 

then X is the solution to ([1]) that is driven by ^ £ 

Xte[a,P], e7 - & = £ l{x.=.} C and |- - C+ = ^ l|x.=/.} (20) 
for all t > T. 

Using the same arguments and references, we can show that, given an interval [a, oo[, 
a point X E [a, oo[, a controlled process C, E and an (J^t)-stopping time r such that the 
solution to ([1]) is such that X,- = x on the event {r < oo}, there exist processes X and 
^ E satisfying ([T]) and such that 

Xt = Xt and it = for all t < r, (21) 

Xte[a,oo[, i^-iU = lhxs=a}dt and ^ - C+ = for alH > r. (22) 

Similarly, given an interval ] — oo, /?] , a point x E ] — oo, /?] , a controlled process ^ E A^ and 
an (J^f)-stopping time r such that the solution to ([T]) is such that X^- = x on the event 
{r < oo}, there exist processes X and E A^ satisfying ([1]) and such that 

Xt = Xt and it = 6 for all t < r, (23) 

XiG]-oo,/3], e7-C+ = and C - C+ = _^ l{x.=/3} C for alH > r. (24) 

Given a generator of an optimal strategy u, we now use the notation and the terminology 
introduced by Definitions [1] and [2] to iteratively construct a process ^* G A^ such that (fT6|l - 
(ITS]) hold true by means of the constructions above. To this end, we introduce the following 
notation, which is illustrated by Figure 1. If int C 7^ and x E C, then we recall that we use 
u'_{x) (resp., M+(x)) to denote the left-hand (resp., the right-hand) first derivative of u at x, 
we define 

sup{?/ < X I y ^ C}, if u'_{x) = 1, 
inf|?/ > X I y ^ C}, if u'_^^{x) = —1 and u'_{x) < 1, 



C(x) 



and we note that C,{x) E M because u is real-valued. On the other hand, given any x E 
we define 



sup{?/ < X I y G intC} and r(x) = infjy > x | y E intC}, 
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with the usual conventions that sup0 = — oo and inf = oo. The algorithm that we now 
develop terminates after finite iterations because each of the sets C, W is a finite union of 
intervals. 

STEP 0: initialisation. We consider the following four possibilities that can happen, 

depending on the initial condition x of ([T]). 

If intC 7^ and x G intC (e.g., see the points X2, Xs, in Figure 1), then we define 
= — X for all t > 0. If we denote by X° the corresponding solution to ([1]) and we set 

To = 0, then has a single jump at time tq, 

«(Xo\) - = m(C(x)) - u{x) = -|C(x) -x\ = -|Ae°l, 

if C{x) < X, then X° = = ({x) = r(C(x)) = r(X°+) is refiecting, 
and, if X < C(x), then X° ^ = X^^ = C(x) = i{C{x)) = i{X^^) is reflecting. 

In this case, Xq E B if x E B C. 

If £{x) = —oo and r(x) = oo, which is the case if intC = 0, then we define = 0, we 
denote by X° the corresponding solution to ([1]) and we let tq = oo. 

If int C 7^ 0, X G M \ intC and either of £(x), r(x) is refiecting (e.g., see the points Xi, X5 
in Figure 1), then we define = 0, we denote by X^ the corresponding solution to ([T]) and 
we set To = 0. 

If int C 7^ 0, X e M \ int C and both £(x), r(x) are repelling if finite (e.g., see the point xg 
in Figure 1), then we consider the (J-t)-stopping times 

T,(,) = inf {t > I Xl<e{x)}, r,(,) = inf {t > I X/>r(x)}, 

where X"^ is the solution to ([I]) for ^ = 0, and we set 

in which expression, we define C[i{x)) — £(x) (resp., C(^(2^)) —r(x)) arbitrarily if i(x) = —00 
(resp., r(x) = 00). If we denote by X° the corresponding solution to ([H) and we set tq = 
Tr(x) A Tk^x), then X° has a single jump at the (J-t)-stopping time tq, 

X° G M \ int C and m(X°+) - m(X°) = -| A^°| for all t < tq, 
on the event {T^(x) < Tr(x)} G J^ro^ the point X°^^ = C(£(x)) is reflecting, 
and, on the event {Tr(x) < ^^(x)} ^ J^toj the point X°^_|_ = C[r{x)) is reflecting. 

In this case, we may have X°^ G B but X°^_,_ ^ B and X° ^ i3 for all t < tq. 

STEP 1: induction hypothesis. We assume that we have determined an (J^()-stopping 
time Tj and we have constructed a process G such that, if we denote by X^ the 
associated solution to ([1]), then f|T6|) - f|T8|) are satisfled for , X^ in place of X* and for 
all t < Tj instead of all positive t. Also, we assume that, if P(r,- < 00) > 0, then one of the 
following two possibilities occur: 
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(I) there exists a point such that Xil^ = on the event {tj < oo}; 

(II) there exist points x{, x^ G M and events A[, A2 G forming a partition of {tj < 00} 
such that f{Al) > 0, X^^^ = x-^ on the event and at least one of i{xl.), is finite and 
reflecting, for A; = 1, 2. 

Step provides such a construction for j = 0. In particular, the last possibility there 
gives rise to Case (II) for 

A? = {T,(,) < T,(,)}, Al = {T,(,) < T,(,)}, xl = C{£{x)) and x° = C{r{x)). 

On the other hand, the second possibility there is such that P(rj < 00) = 0, while the 
remaining two possibilities give rise to Case (I). 

STEP 2. If F{Tj < 00) = 0, then define C = X* = X^ and stop. Otherwise, we 
proceed to the next step. 

STEP 3. We address the situation arising in the context of Case (II) of Step 1; the 
analysis regarding Case (I) is simpler and follows exactly the same steps. To this end, we 
first consider the (J-'t)-stopping time f = tjI^j + ool^j and we note that Xl = x\ on the 
event {f < 00}. We are faced with the following possible cases. 

If both of ^(a;{), r(xj) are finite and reflecting, then we appeal to the construction asso- 
ciated with f[T^ - fl2U]) for = 1 X = X^ , x = x{ and r = f to obtain processes C,, X that 
are equal to , X^ up to time f and satisfy (!20|) for all t > f. We then define 

e+^ = e, X^'+i = X and r,-+i = ool^. +rjl^.. 

The result of this construction is such that -^rj^i+ = on the event {tj+i < 00} = A^, 
which puts us in the context of Case (I) of Step 1. 

If i{x{) is finite and reflecting and r{x{) = 00 (resp., i{oc{) = —00 and r{oc{) is finite 
and reflecting), then we proceed in the same way using the construction associated with 

If i{x\^) is finite and reflecting and r{x{) is finite and repelling, then we consider f l2ip - (l22]) 
and, as above, we construct processes ^, X that are equal to , X^ up to time f and satisfy 
f l22|) for all t > f. We then consider the (J-i)-stopping time f''" and the process ^^^^ G 
given by 

we denote by X^~^^ the associated solution to ([1]) and we define 

r,+i = ftl^. + T,l^, Ai+i = {ft < 00}, Ai-"' = Ai xf^' = C{r{x{)) and a:^^^^ = xi . 
In this case, we may have -^t^+i G B but Xrj_^_-^^+ ^ B and Xt ^ B for all t G jrj, Tj+i[. 
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Finally, if i{x{) is finite and repelling and r{x{) is finite and reflecting, then we are faced 
with a construction that is symmetric to the very last one using fl23l) - fl24l) . 

STEP 4 . Go back to Step 2. □ 



We now prove the main result of the section. It is worth noting that we can relax 
significantly the assumptions (|271)- (|28ll . However, we have opted against any such relaxation 
because (a) this would require a considerable amount of extra arguments of a technical nature 
that would obscure the main ideas of the proof and (b) fl27|) - fl28|l are plainly satisfied in the 
special cases that we explicitly solve in Sections [5] and El 

Theorem 1 Consider a function m : R — )■ ]R_|_ that is a generator in the sense of Definition^ 
let ^* G be the control strategy constructed in LemmaUl X* be the associated solution 
to (QP and define 

v{y) = max{u{y),g{y)}, foryeR. (25) 
Also, given any ^ G A^, define 

t: = r:(0 = inf {t > I X,eS}, < = ^(0 = inf {t > | G S} , (26) 

where X is the associated solution to (QP, and note that t* M r* = t*. In this context, the 
following statements are true. 

(I) J^(C*, t) < v{x) and J^i^*, t) < u{x) for all t E At and all initial conditions of (Qp. 

(II) v{x) = Jl{i*i'T*u) <^^^ '^i.^) = Jxi^*i'''u) /^^ every initial condition x of ^ such that 

supu(X;) < /sTi, (27) 

for some constant Ki = Ki{x). 

(III) // there exists a constant K2 such that 

u{y) < K2 for allyeR\S, (28) 

then v{x) < J^{C,,t*) and u{x) < t/"(.^,r*) for every initial condition x of (Qp. 

(IV) If u satisfies ^2^, then (^*,t*) (resp., (C^'^u)) ^■^ '^^ optimal strategy for the game with 
performance criterion given by ^ (resp., ^) and v{x), u{x) satisfy ^ for every initial 
condition x of (J\), namely, v and u are the value functions of the two games. 

Proof. Given a generator -u, we denote by u" the unique, Lebesgue-a.e., first derivative of 
m' in M \ i3 and we define u"{x), u'{x) arbitrarily for x in the finite set B. In view of fll6p . 
we can use Ito's formula and the integration by parts formula to calculate 

e-^^u{X*) = u{x) + [ e-^'CuiXl) dt + I e-^'M'(X;) d^t 

Jo J[0,T[ 

+ J2 e"^* - - u'{x:)Ax:] + , 

0<t<T 
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where 



[ e-^'a{X*)u'{X*) dWt. (29) 
Jo 

Rearranging terms and using (fT7j) - (fT8l) . we obtain 

[ e-^'h{X;)dt+ [ e-^'di; + e-^^u{X^) 

Jo J[0,T[ 

= uix)+ r e-^^[CuiX:) + hiX:)]dt+ r e-''^[l + u'{X:)]d{cX 
Jo Jo 

+ I e-^' [1 - u'{x;)\ d{r); + Yl H^t+) - u{x;) + |Ax;i] + m* 

"^0 0<t<T 

= u{x)+ [ e-^'[Cu{X;) + h{X;)]dt + M^. 
Jo 

It follows that, given any finite (J-t)-stopping time f, 

[ e-^'h{X;)dt+ [ e-^' dCt + e-^' g{X;) 

Jo J[0,f[ 

= u{x) + e-^^ [g{X;) - u{X;)] + f e"^* [Cu{x;) + h{x;)\ dt + M? 
= M(x)l|o<f} + e~^^ [g{X;) - u{X;)] l|o<f} + g{x)l{r=o} 

+ / e-^'[Cu{x;) + h{x;)\dt + M;. (30) 

Jo 

Similarly, we can calculate 



" e-^*/i(X;) dt + / e-^' dCt + e-^^^7(X?+) 

+ e-^^ - n(X?+)] + r e~^^ [Cu{X;) + /.(X;)] dt + M;. (31) 

^0 



Combining (15U]) with (IT7|) and the facts that < (^(x) < 'u(x) for all x G M \ C = 
int(VV U 5>v) and Cu{x) + /i(x) < Lebesgue-a.e. in M \ C, we can see that, given any T > 
and any (J^()-stopping time r. 



pTAt p 

/ e-^*/i(X;)dt+ / e-^'4* + e-^-(7(X;)l|.<r| 

^0 ^[O.rArf 



'[0,TA7 

< u{x)l{o<r} + 9{x)l{r=o} + M*^^ < v{x) + M^^,, (32) 
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the last inequality following thanks to f l25|) . These inequalities and the positivity of /i, g 
imply that the stopped process M*'^ is a supermartingale and E[My^^] < 0. Therefore, we 
can take expectations is fl32l) and pass to the limit T — t- oo using Fatou's lemma to obtain 
the inequality J^i^*-, t) < v{x). Making similar reasoning with flHT]) . we derive the inequality 
J^{.i\r) < u{x), and (I) follows. 

To prove (II), we consider the (J-t)-stopping time r* defined by (!26|) with X* instead of 
X, and we note that 

X* ecm = R\ int(C U S) for all < t < t*. 

Combining this observation and the definition of r* with the facts that g{x) < u{x) = v{x) 
for all X G W and v{x) = g{x) for all x G 5, we can see that 

«(^r*)l{r;>0} = g{X;,)l{r;>0}, 

v{x)l{r*=o} = g{x)l{r;=o} and v{x)l{r;>o} = u{x)l{r;>o}- 

In view of these observations, (I5U]) and the fact that Cu{x) + h{x) = Lebesgue-a.e. in W, 
we can see that, given any T > 0, 

/ "e-^'/i(X;) dt + / e-^* di: + e-^^.*(?(X;,)l|.*<T} + e~'^-u{X*)l^r<r!} 

Jo J[0,TAr*[ 

If we denote by a localising sequence for the stopped local martingale M*'^^ such that 
Qn > for all n > 1, then we can see that these identities imply that 



E 



e-^*MX;) dt+ j e-^' dil + e-^^.*(?(X;,)l|..<,„} 

VO ^[0,(?nAr*[ 



+ e-^-«(X*Jl|,„<.*} 



In view of fl27j) and Assumption [21 we can pass to the limit as — )■ oo using the monotone 
and the dominated convergence theorems to obtain J^{Ct*) = v{x). 
We can use fl3T|) and the observations that 

X; G cl W = M \ int (C U S) for all < t < r* and m(X;*+) = g{X;^^) 

to show that J^{Ct*) = u{x) similarly. 

To establish Part (III), we consider any admissible ^ & and we note that (l30l) remains 
true with ^, X instead of X* if f is replaced by f A r* because B <^ S. Also, we note that 

XteR\S = {WUC)\S foralH<r;. (33) 
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In view of the facts that g{x) < u{x) = v{x) for all a; G M \ 5 and u{x) < g{x) = v{x) for all 
x G iS, we can see that this observation and the definition of r* imply that 

u{Xr;)l{r;>o} < ^(X^.)l{r;>0}, 
v{x)l{ri=o} = gix)l{r;=o} and v{x)l{r;>o} = u{x)l{r;>o}- 

Combining these observations with the fact that Cu{x) + h{x) > Lebesgue-a.e. inside 
int[(>V U C) \ iS], we can see that ( !30l) implies that, given any T > 0, 

^0 Jio,tat*[ 

> M(a;)l{o<r;} + e-^-a [^(^rj) - u{Xr;)] l{o<r;<T} + g{x)l{r;=o} + Mtat; 

> v{x)+MTAr:. 

where M is defined as in ( l29l) . If (^„) is a localising sequence for the stopped local martingale 
M'^" such that ^„ > for all n > 1, then these inequalities imply that 



E 



^0 J[o,enAT;\ 



+ e-^-n(X* )1 



4en<T*} 



In view of (l28l) and Assumption [21 we can pass to the limit as n — )■ oo using the monotone 
and the dominated convergence theorems to obtain J^(^,r*) > v{x). 

In general, the inequality r* < r* may be strict because, e.g., we may have x G 5 and 
X + A^o G M \ iS. In such a case, the set [t G [0, r*[ | G may not be empty but it 
is finite. Therefore, we can use Ito's formula to derive (!30|) with ^, X instead of X* and 
with f At* replacing f. Combining this result with the observations that 



Xt G cl(M \ S) for all < t < r* and < g{Xr* 



we can derive the inequality J"(^,r*) > u{x) as above. 

Finally, Part (IV) follows immediately from Parts (I)-(III) and the fact that (!28|) implies 
trivially ([27]). □ 



Remark 1 An inspection of the proof of Theorem [T] reveals that the optimal strategy (^*, r*) 
of the game where the controller has the first-move advantage is highly non-unique. Indeed, in 
the presence of ( 128|) . (^*, f*), where f* is any (J^4)-stopping time such that X|*_,_l{f;.<oo} ^ 
in particular, (^*, oo), is also an optimal strategy. It is worth noting that a similar observation 
cannot be made for the game where the stopper has the first-move advantage. Both of the 
special cases considered in the following two sections provide cases illustrating this situation 
(see Propositions [H [3 [7| and [8]) . □ 
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5 The explicit solution to a special case with quadratic 
reward functions 



We now derive the explicit solution to the special case of the general problem that arises 
when 



b{x) = 0, cr(x) = 1, S{x) = 5, h{x) = Kx^ + /i and g{x) = Ax^ for all x G jr, 



for some constants 5, k, A > and n > 0. In our analysis, we exploit the symmetry around 
the origin that the problem has, we consider only sets F C M such that {—x \ x G F} = F 
and we denote F"*" = F n [0, oo[. Also, we recall that the general solution to the ODE 



is given by 



Cw{x) + h{x) = -w"{x) — 6w{x) + Kx^ + /X = 
2 



w{x) = A cosh y/25x + B sinh V25x + —x^ H To~^' 

0^ 



for some constants A,B G M. 

In the special case that we consider in this section, the controller should exert effort to 
keep the state process close to the origin. On the other hand, the stopper should terminate 
the game if the state process is sufficiently far from the origin. In view of these observations, 
we derive optimal strategies by considering generators that are associated with the regions 

5+=[a,oo[, C+=[/3,oo[ and W+=[0,aA/3[, (34) 

for some constants > (see Definition [1]). In particular, we derive three qualitatively 
different cases that are characterised by the relations (3 < a, a < (3 or a = (3, depending on 
parameter values (see Figures 2-4). 

Given such generators. Theorem [T] implies that the associated optimal strategies can 
be described informally as follows. The controlled process ^* has an initial jump equal to 
— {x + (3) (resp., —{x — (3)) if the initial condition a; of ([1]) is such that x < —(3 (resp., x > (3). 
Beyond time 0, ^* is such that the associated solution to ([1]) is reflecting in —[3 in the positive 
direction and in /3 in the negative direction. On the other hand, the optimal stopping times 
r*, r* are the first hitting times of S as defined by fl2^ . In view of these observations, we 
focus on the construction of the generators u in what follows. 

In the first case that we consider, the generator u identifies with the value function of 
the singular stochastic control problem that arises if the stopper never terminates the game 
(see Figure 2). In particular, we look for a solution to the variational inequality 

min I -u"{x) — 6u{x) + kx^ + yU, 1 — |m'(x)| r = (35) 
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of the form 

,, jAcoshV2Sx + lx'' + ^, if\x\<P, 
[x-(3 + u{(3), if |x| > (3. 

The requirement that u should be along the free-boundary point (3, which is associated 
with the so-called "principle of smooth fit" of singular stochastic control, implies that the 
parameter A should be given by 

A = (37) 

while f3 > should satisfy 

tanhy25/3 = ^^^4^. (38) 



We also define a > to be the unique solution to the equation 

u{a) = W. (39) 

Proposition 2 Equation has a unique solution /3 > 0, which is strictly greater than 
^ . Furthermore, a > (3 if and only if 

6X — K < or 6X — K = and /i > 



^ , 1 / 25/i / 2Sfi S' 

or 6X - K > and tanhi I ^ < W 1=, (40) 

^' 6X- K y 6X- K K^/2S 



in which case, C( > ^'^'^ function u defined by for A < given by [3^ is a 
generator in the sense of DefinitionUi 

Proof. It is straightforward to see that equation ( !38|) has a unique solution /3 > and that 
this solution is strictly greater than In particular, we can verify that 

, /— 5(2kx-6) f>0 for all X G [0,/3[, 

tanhV25x-^ < ^ ^ (41) 

kv26 I < for all x e ]f3, oo[. 



For this value of /3 and for A < given by fl371) . the function u defined by fl36|) is and 
satisfies the variational inequality fl35|) because 

|m'(x)|<1 for all |x| G [0,/3], (42) 

Cu{x) + h{x) = ^u"{x) - 6u{x) + Kx^ + /i > for all |x| G [(3, oo[. (43) 



To see fH2l) . we first note that u"'{x) = (25)2 Asinh v25x < for all x G [0, which implies 
that the restriction of u" in [0, P] is strictly decreasing. Combining this observation with the 
identities 

m"(0) = ^ f 1 - — > and u"{f3) = 0, 
V cosh V26 13 J 

17 



we can see that u"{x) > for all x G [0,/3[. It follows that u is an even convex function, 
which, combined with the identities u'{0) = and u'{/3) = 1, implies fH2l) . 
To prove fHSl) . it suffices to show that 



:= -u"{x) — 6u{x) + Kx^ + /i = Kx"^ — 5x + 5(3 — 5u{(3) + /i > for all x > (3. (44) 

The definition and the continuity of u imply that fi{(3) = 0. Combining this observation 
with the inequality f[{x) = 2k{x — ^) > for all x > (3, which follows from the fact that 
/3 > ^, we can see that (jS]) is true. 

To show that the point a defined by f l5^ is strictly greater than (3 if and only if fHU]) is 
true, we note that the linearity of u in oo[ implies that there exists a > (3 such that ( 139|1 
is true if and only if u{(3) > X(3^. In particular, if such a exists, then a > Using the 
definition (136|) of m, we calculate 

2 / cosh \/26x \ 5X — K, 2 

u(x) — Xx = — 1 ; — X + — , for \x\ < p. 

\ cosh V26/3 J S (5 ' ' 

If 6X — K < 0, then this identity implies trivially that 

u{x) > Xx^ for all |x| < (3. (45) 

Similarly, if (5A — k = and /i > 0, then (H5l) is true. On the other hand, if — k > 0, 

then (l45l) is true if and only if /3 < ^^J j^z;: because the function x ^ u{x) — Ax^ is strictly 

decreasing in [0,/3]. Therefore, if 5A — k > 0, then ( H5l) is true if and only if the very last 
inequality in (HOll holds true, thanks to (HTl) . It follows that the equation u{x) = Xx^ has a 
unique solution a > (3 \/ if and only if fj40l) is true. 

Finally, it is straightforward to check that, if f HOj) is true, then u is associated with the 
regions B = = 0, C+ = oo[, = [a,oo[ and W"*" = [0,/3[, and satisfies all of the 
conditions required by Definition [T] for it to be a generator of an optimal strategy. □ 

We next consider the possibility that the game's value function when the stopper has the 
"first-move advantage" identifies with the value function of the optimal stopping problem 
that arises if the controller never acts (see Figure 3). In this case, we look for a solution to 
the variational inequality 

max |-f"(x) — Sv{x) + kx^ + /x, Ax^ — t>(x)|- = 

of the form 

fAcoshy25x + fx2 + ^, if|x|<a, 
= < _ 2 .„ , , (46) 

Ax , if X > a. 
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The requirement that v should be along the free-boundary point a, which is associated 
with the so-called "principle of smooth fit" of optimal stopping, implies that the parameter 
A should be given by 

5{5\ — K)a'^ — (k + 6fi) 



A 



52 cosh V 25a 



while a > should satisfy 



tanh V 25a 



25{S\ - K)a 



6{6X — K)a^ — (k + 



(47) 



(48) 



In this context, the function u defined by 



uix] 



AcoshV26x+^x^ + !^ 



4A' 



if < a, 
if |x| 
if |x| > 



(49) 



provides an appropriate choice for a generator ii a < 



Proposition 3 Suppose that 6X — k > 0. Equation [J8\ ) has a unique solution a > 0, which 
is strictly greater than y^^^^y ■ This solution is less than or equal to ^ if and only if 



2A 



> 



K + 6fJ, 

6{SX - k) 



and tanh 



25 



2\ 



> 



2S{S\ - k)\ 



6{6X- k) ~A{k + 6i2)X^' 



(50) 



in which case, the function u defined by ( [TPP for A > given by ( f77| ) is a generator in the 
sense of DefinitionUl 



Proof. The calculation 
d 



a 



< 



da 6{6X - K)a^ -{k + 5/i) [S{SX - K,)a^ + 6fi)Y 

implies that the right-hand side of f l48|) defines a strictly decreasing function on M_|_ \ 
|y^^^^y|. Combining this observation with the fact that tanh is a strictly increasing 
function, we can see that P8|) has a unique solution a > and that this solution is strictly 



greater than y^^i^rj^- particular, we can see that 



tanh V 2Sx — 



26{6X - k)x 



> 0, if X G 



6{6X - k)x^ - (k + ^/^) < 0, if x e 



0, 



' Y (5((5A-k) 
<5(<5A-k) ' " 



U ]a, oo[. 



(51) 
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which imphes that the solution a of (j48|) is less than or equal to 2^ if and only if the 
inequalities in f l50|) are true. 

In what follows, we assume that the problem data satisfy fl50|) . in which case, u is asso- 
ciated with the regions B = = [a, 2^] , C+ = = 00 [ and = [0, a[. In view 
of Definition [T|, we will show that the function u is a generator if and only if we prove that 



u'{x) < 1 for all X G [0, a] 
u{x) — Ax^ > for all x E [0, a] 



1 



Cu{x) + h{x) = -u"{x) — 6u{x) + KX^ + /X < for all a: G 



a. 



2A 



(52) 
(53) 

(54) 



The inequality (!52|) follows immediately from the convexity of u and the fact that u'{a) = 
2\a < 1. The inequality (!53|) is equivalent to 

Si6X - .)a^ -{. + 5^) ^ 6{6X-.)x^-{. + 6f.) ^_ ^^^^^ ^ ^ ^^^^ 



cosh \'2Sa 



cosh v 2Sx 



Since a > 

fl5T]) to calculate 



this is plainly true for all x < 



S{S\-k) 



. On the other hand, we can use 



25 [5{5X - k)x^ -{k + 5/i)] 



cosh V 25x 



> for all X G 



25{5X - k)x 



5{6X — K,)x^ — (k + 6fi) 



cosh V 25a; 



K + 6fi 

6{6X - k) 



, a 



and ( l53l) follows. 

The inequality is equivalent to 

A — (SX — k)x^ + < for all X G 
In view of ( 15T]) . this is true if and only if 



a. 



2A 



A + /i 
5A — K 



(5A — K 



5A — ft 



because 



2<?(A+m) 
<5A— K 



> 



(5(1a-k) 5A — ft > 0. This inequality is indeed true because 



> 1 ^ (5A + ft + 2(5/i > 0, and ^ follows. 



□ 
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The third case that we consider "bridges" the previous two ones and is characterised by 
the fact that the free-boundary points a, /3 may coincide in a generic way. In particular, we 
look for a generator u that is given by 

fAcoshy25x+fa;2 + ^, if |x| < a, 
I X — a + u{a), if |x| > a, 

for some a > 0, and satisfies 

u{a) = Aa^ (57) 

(see Figure 4). The requirements that u should satisfy fl571) and be at a imply that the 
parameter A should be given by 

5^ cosh \/26a 

while the free-boundary point a > should satisfy 

tanhV25a = —= ^ ^ . 59 



Proposition 4 Suppose that 5\ — k > and y ^^fx^ly 4k.- Equation ( f5^) has a unique 
solution a > such that 



5 K + 6a , 1 S K + 6u 

if — < \ T7^. — then —< — < a < \ hrrr-. — (60) 
^ 2k V(5(5A-/t)' 2A 2k V5(5A-k)' ^ ' 



while 



^/ \ T7T\ — ^ < 7^? then W-r-TT — ^ < a< — . (61) 
^'6{6X-k) 2k ]J6{6X-k) 2k ^ ' 

If the parameters are such that / f^) is true, then the function u defined by / fS^) for A < 
given by is a generator in the sense of DefinitionUl if and only if 



ta„,,,_^>,/_|^^^_J^. (62) 

\ S\-K \ 5\~K kV26 

On the other hand, if the parameters are such that ( fgij) is true, then < a if and only if 



1 ^ I K + 6^ 



2A - V 6{6X - k) 



or ^ y I " + ^^ and tanh ^ - ^^^^ " f63) 
2A > V 6{6X - k) "''^ ^^""^ 2A < 5(5A - k) - A{k + 5/i) A^ ' ^^"^^ 



in which case, the function u defined by / f5q) /or A > g'zwen / f5^) is a generator in the 
sense of DefinitionUl 
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Proof. If we denote by /3(a) the right-hand side of fl59l) . then we can check that 



and 



/3(«) 



(64) 



If ^ < w ^px^' then these calculations imply that 



/3(a) > and /g (a) > for all a G 
Combining these inequalities with the observations that 
/3(a) < for all a G 



b K + bfj, 



2k' Y b{bX-K) 



' b 








u 











K + bfi 
b{bX - k) 



00 



2k 



and lim /3(a) = 00, 



and the fact that the restriction of tanh in R+ is strictly concave, we can see that equation 
(!59|) has a unique solution a > 0, which satisfies (160|1 . In particular, we can see that 



tanh V 2ba 



b{b - 2Ka) 



> 0, ifa;e]0,a[U 



2b [b{bX - K)a^ - + < 0, if X e 



a, 



<5(<5A-ft) ' 



00 



1 Y <5(<5A-k) 



(65) 



If V ^SS) < then (El implies that 

/3(a) < for all a E 
This inequality and the calculations 



K + bfi b 



b{bX-K)'2K 



fsi^a) < for all x G 



0, 



K + bfi 
b{bX - k) 



U 



lim /3(a) = 00 and fs' 

I K+Sfi \ ZK 

6{S\-K.) 



b_ 

2^' 
= 0, 



00 
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imply that equation ( 159|) has a unique solution a satisfying fl6T|) . In particular, we can see 
that ^ 

— < a <S=^ fl63|l is true. 
2A 

In view of Definition [H we can see that the function m is a generator of an optimal 
strategy if and only if 

< 1 for all |x| < a. (66) 



If the parameters are such that (I6T1) is true, then this inequality follows immediately from 
the boundary conditions u'{0) = 0, u'_{a) = 1 and the fact that u is convex, which is true 
because A > 0. If the parameters are such that fl60l) is true, then A < 0. In this case, 
u"'{x) = (26)^ Asinh.\/26x < for all x G [0,a[, which implies that u" is strictly decreasing 
in [0,a[. Combining this observation with the fact that u is an even function, we can see 

that fl66l) is true if and only if \imx^au"{x) > 0, which is equivalent to a > \Jj^^- In view 

of fl65|) and the fact that \Jj^^ < \J s(^s\^^y we can see that this indeed the case if and only 
if (El is true. □ 



The results that we have established thus far involve mutually exclusive conditions on the 
problem data. To exhaust all possible parameter values, we need to consider the following 
result that involves a generator u of an optimal strategy that is associated with the regions 



E = S- 



2k 



oo 



and W 



+ 



0.A 

2k 



(67) 



which are consistent with (1341) for a = /3 = and the proof of which is straightforward. 



Proposition 5 Suppose that 6X — k > and J s{5\-k) ~ Ik.- -^^^ function u defined by 



u[x) 



K™2 _|_ 



if \x\ > 



2ft' 
<5 



(68) 



is a generator of an optimal strategy in the sense of DefinitionUi 



6 A special case with generators that are not 

We now solve the special case of the general problem that arises when 



b = 0, a = 1, 6 = 6, h = and g{x) 



-Xx"^ + A, if |x| e [0, 1], 
0, if Ixl > 1, 
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for some constants 5, X > 0. In this context, the controller has no incentive to exert any 
control action other than to counter the stopper's action because h = 0. We therefore solve 
the problem by first viewing the game from the stopper's perspective. Also, we exploit the 
problem's symmetry around the origin in the same way as in the previous section. 

We first consider the possibility that the generator of an optimal strategy u identifies 
with the value function of the optimal stopping problem that arises if the controller never 
takes any action. To this end, we look for a solution to the variational inequality 

max ^-^"(x) — 5u{x), — Ax^ + A — 'u(x) j> = 

of the form 

J -Ax^ + A, if |x| < a, 
u[x) = < ^ , , (69) 

V ' |Ae-^^ if |x| > a, ^ ' 

for some constants A and a G ]0, 1[. A generator of this form is associated with the regions 

i3 = C = 5c = 0, 5+ = [0, a] and W+ = ]a, cx)[, (70) 

and is depicted by Figure 5. To determine the constant A and the free-boundary point a, we 
appeal to the so-called "principle of smooth-fit" of optimal stopping. We therefore require 
that u is at —a and a to obtain 



A = A(l-a2)e^" and a = ^ + + (71) 



In this case. Theorem [T] implies that the associated optimal strategy can be described 
informally as follows. The controller should never act (i.e., ^* = 0), while the stopper should 
terminate the game as soon as the state process takes values in iS = [—a, a] (i.e., r* = r* is 
the first hitting time of [—a, a]). 

Proposition 6 The function u defined by for A > 0, a & ]0, 1[ given by [71\ ) is a 
generator of an optimal strategy in the sense of Definition^ if and only if 

-1 



a<^ ^ A<-( ^ + + . (72) 

- 2A - 2 I 725 V 25 ' ^ ^ 



Proof. In view of fITOl) and Definition [H we will prove that m is a generator of an optimal 
strategy if we show that 

u\x) > -1 for all X > 0, (73) 
u{x) > — Ax^ + A for all x > a, (74) 
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and 



Cu{x) + h{x) = -u"{x) — 5u{x) < for all x G [0, a]. (75) 

The inequality ( |74l) follows immediately by the facts that u is at a and the restriction 
of X (— )■ u{x) + Ax^ — A in [a, oo[ is strictly convex. The inequality fl75|) is equivalent to 
< 1 + 5'^ for all x G [0,0;], which is true because a < 1. Finally, the inequality fl73|) is 
true if and only if u'{a) > — 1 because the restriction of u' in [0, oo[ has a global minimum 
at a. Combining this observation with the identity u'{q) = —2Xa and ( ITTi) . we can see that 
( 1731) is satisfied if and only if ( 1721) true. □ 



If the problem data is such that (1721) is not true, then we consider the possibility that an 
optimal strategy is characterised by a generator u that is associated with the regions 

= {/?}, 5+=[0,/3], C+=5+ = [/3,a] and W+ = ]a,oo[, (76) 

for some < (3 < a < 1, and is depicted by Figure 6. In particular, we consider the function 

-Ax^ + A, 

u{x) = — X — Aa^ + a + A, if |x| G a], (77) 



if 


X 


</3, 


if 


X 


G ]/3,a 


if 


X 


> a. 



The requirement that u should be continuous at (3 yields 

A/32 - /3 = ^^2 _ 

while, the requirement that u should be along —a, a, implies that 



A = X{1- a')e^''° and a = ^ / 1 ^. (79) 

Av 25 



In view of Theorem [H we can describe informally the associated optimal strategy as 
follows. If the initial condition x of ([1]) belongs to ] —(3, (3 [, then the controller should wait 
until the uncontrolled state process hits {— /3, at which time, the controller should apply 
an impulse to instantaneously reposition the state process at —a or a, whichever point is 
closest. As soon as the state process takes values in ] —00, —a] (resp., [a, oo[), the controller 
should exert minimal effort to reflect the state process in —a in the negative direction (resp., 
in a in the positive direction). On the other hand, the stopper should terminate the game 
as soon as the state process takes values in 5 = [—a, a]. 
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Proposition 7 The point a defined by [7V^ is strictly greater than and there exists (3 G 
[0, a[ satisfying ( (7gy if and only if 

\ ~^ f I \ 

(80) 

in which case, P < If the problem data satisfy these inequalities, then the function u 
defined by (71\ ) for A > 0, a E ]0, 1[ given by (f7P| ) is a generator of an optimal strategy in 




the sense of DefinitionUl 

Proof. It is a matter of straightforward algebra to verify that a > if and only if the 
first inequahty in flHOj) is true, which we assume in what follows. Similarly, it is a matter of 
algebraic manipulations to show that the constant on the left-hand side of flHOj) is strictly 
less than the constant on the right-hand side of flHOj) . Combining the inequality o > with 
the strict concavity of the function x Ax^, we can see that there exists /3 G [0,a[ such 
that the function u defined by ( 1771) is continuous and u{x) < \x^ for all x G if and 

only if A < —Xa^ -|- a + A, which is equivalent to the second inequality in (IHOl) . 

We now assume that the problem data is such that (IHOj) is true. In view of the arguments 
above, (176|) and Definition [H we will prove that m is a generator if we show that 

u'{x)>-l for all X G [0,/3[U]a,cx)[, (81) 

u{x) > -Ax^ + A for all x > a, (82) 

and 

Cu{x) + h{x) = ]^u"{x) - 6u{x) < for all x G [0, /?]. (83) 

The inequalities f lHTj) and f l82|) follow immediately by the facts that u is at a, the restriction 
of X I—)- m(x) + Ax^ — A in [a, oo[ is strictly convex and Q<(3<^<a<l. Finally, the 
inequality f l5^ is equivalent to x^ < 1 + 5^^ for all x G [0,/3], which is plainly true because 
/3 < 1. □ 

The final possibility that may arise is associated with the regions 

B = {0}, Syv = 0, C+ = 5^ = [0, a] and = ]a, oo[, (84) 

for some a G ]0, 1[, and is depicted by Figure 7. In this case, the generator of an optimal 
strategy is given by 



-X — Aa^ + a + X, if |x| G [0, a] 



V ^ ^ Ae-^^ if Ixl >a. ^ ^ 
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The constant A and the free-boundary point a are characterised by the requirement that u 
should be along —a, a, and are given by fl79|) . 

In this case, Theorem [1] implies that the associated optimal strategy can be described 
informally as follows. The controlled process ^* has an initial jump equal to —{x + a) (resp., 
— {x — a)) if the initial condition x of ([T]) is such that x G ] —a, O] (resp., x G ]0, a]). Beyond 
time 0, ^* is such that the associated solution to ([1]) is reflecting in —a in the negative 
direction if Xq^ < —a and in a in the positive direction if X^_^_ > a. On the other hand, the 
stopping time r* = r* is the first hitting time of S = [—a, a]. 

Proposition 8 The function u defined by (7l\ ) for A > 0, a G ]0,1[ given by ( fTPP is a 
generator of an optimal strategy in the sense of Definition\J\ if and only if 




Proof. The inequality u{x) < Ax^ for all x G [0, a[ that characterises the region Sc = [—a, «] 
is true if and only if A > — Aa^ + a + \, which is equivalent to ( 186|) . Otherwise, the proof of 
this result is very similar to the proof of Proposition [71 □ 
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r(xi) = ((X2) = ((xs) ((X4)=e(x5) r(x5) = ((e(xe)) 



Cir(xe)) 



Figure 1. Illustration of the functions ^, i, r appearing in the proof 
of Lemma 1. The vertical solid lines also demarcate the region C. 
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Figure 2. The functions u and v in the context of Proposition [2j 
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Figure 4. The functions u and v in the context of Proposition |H 
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Figure 7. The functions u and v in the context of Proposition |8l 
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